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PREVIOUSLY BEEN PAID IN THIS APPLICATION (AS SHOWN ABOVE), THE RETURN OF PART B OF THIS FORM 
WILL BE CONSIDERED A REQUEST TO REAPPLY THE PREVIOUSLY PAID ISSUE FEE TOWARD THE ISSUE FEE NOW 
DUE. 



HOW TO REPLY TO THIS NOTICE: 



I. Review the SMALL ENTITY status shown above. 

If the SMALL ENTITY is shown as YES, verify your current 
SMALL ENTITY status: 
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1. Change of correspondence address or indication of "Fee Address" (37 
CFR 1.363). 

Q Change of correspondence address (or Change of Correspondence 
Address form PTO/SB/122) attached. 

Q "Fee Address" indication (or "Fee Address" Indication form 
PTO/SB/47; Rev 03-02 or more recent) attached. Use of a Customer 
Number is required. 



2. For printing on the patent front page, list 

(1) the names of up to 3 registered patent attorneys 
or agents OR, alternatively, 

(2) the name of a single firm (having as a member a 
registered attorney or agent) and the names of up to 
2 registered patent attorneys or agents. If no name is 
listed, no name will be printed. 



3. ASSIGNEE NAME AND RESIDENCE DATA TO BE PRINTED ON THE PATENT (print or type) 

PLEASE NOTE: Unless an assignee is identified below, no assignee data will appear on the patent. If an assignee is identified below, the document has been filed for 
recordation as set forth in 37 CFR 3.11. Completion of this form is NOT a substitute for filing an assignment. 
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Advance Order - # of Copies Q The Director is hereby authorized to charge the required fee(s), any deficiency, or credit any 

overpayment, to Deposit Account Number (enclose an extra copy of this form). 

5. Change in Entity Status (from status indicated above) 

□ a. Applicant claims SMALL ENTITY status. See 37 CFR 1.27. □ b. Applicant is no longer claiming SMALL ENTITY status. See 37 CFR 1.27(g)(2). 

NOTE: The Issue Fee and Publication Fee (if required) will not be accepted from anyone other than the applicant; a registered attorney or agent; or the assignee or other party in 
interest as shown by the records of the United States Patent and Trademark Office. 
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an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This collection is estimated to take 12 minutes to complete, including gathering, preparing, and 
submitting the completed application form to the USPTO. Time will vary depending upon the individual case. Any comments on the amount of time you require to complete 
this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer, U.S. Patent and Trademark Office, U.S. Department of Commerce, P.O. 
Box 1450, Alexandria, Virginia 22313-1450. DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 1450, 
Alexandria, Virginia 22313-1450. 

Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number. 
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(application filed on or after May 29, 2000) 

The Patent Term Adjustment to date is 917 day(s). If the issue fee is paid on the date that is three months after the 
mailing date of this notice and the patent issues on the Tuesday before the date that is 28 weeks (six and a half 
months) after the mailing date of this notice, the Patent Term Adjustment will be 917 day(s). 

If a Continued Prosecution Application (CPA) was filed in the above-identified application, the filing date that 
determines Patent Term Adjustment is the filing date of the most recent CPA. 

Applicant will be able to obtain more detailed information by accessing the Patent Application Information Retrieval 
(PAIR) WEB site (http://pair.uspto.gov). 
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(571)-272-4200. 



PTOL-85 (Rev. 08/07) Approved for use through 08/3 1/2010. 



Page 3 of 3 



Notice of Allowability 


Application No. 

10/583,650 


Applicant(s) 

MILOV, DENIS SERGEEVICH 


Examiner 

FAZLULQUADER 


Art Unit 

2164 





— The MAILING DATE of this communication appears on the cover sheet with the correspondence address— 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1 .313 and MPEP 1308. 

1 . This communication is responsive to 04/16/2010 . 

2. ^ The allowed claim(s) is/are 1-25 . 

3. D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a) □ All b)DSome* c) □ None of the: 

1. D Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1 ) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1.84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

1 . M Notice of References Cited (PTO-892) 

2. □ Notice of Draftperson's Patent Drawing Review (PTO-948) 

3. □ Information Disclosure Statements (PTO/SB/08), 

Paper No./Mail Date 

4. □ Examiner's Comment Regarding Requirement for Deposit 

of Biological Material 



5. Q Notice of Informal Patent Application 

6. □ Interview Summary (PTO-413), 

Paper No./Mail Date . 

7. O Examiner's Amendment/Comment 

8. ^ Examiner's Statement of Reasons for Allowance 

9. □ Other . 
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Art Unit: 2164 

DETAILED ACTION 



1 . Claims 1-25 are pending in this application. 



Allowable Subject matter 

2. Claims 1-25 are allowed. 

The examiner deems claims 1-25, as novel when viewed as a whole for the 
limitations of iterative search with data accumulation in cognitive control framework. 

The closest prior art of record, Steinberg discloses searching hypotheses for 
locations of objects in a playback image corresponding to a recorded image generated 
by a graphical user interface (GUI) of an application program comprising: capturing the 
playback image (Steinberg: [0149], acquisition of playback image); detecting at least 
one active object in the recorded image (Steinberg: detection of image); searching 
subsets of hypotheses from the playback image for an object according to 
predetermined criteria (Steinburg: [0165], using predetermined criteria; [0193], using 
predefined criteria); recalculating old actions for the object in the playback image by 
applying actions according to an execution scenario and loading a next set of data, 
when the object is found (Steinberg: iteratively calculating image parameters); and 
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although, Steinberg discloses calculating relative size and location of image objects 
(Steinberg: [0165]), Steinberg, however, does not explicitly disclose checking of 
dynamic conditions. Kuth, however, discloses checking of dynamic conditions or 
parameters (Kuth: [0027], parameters for the dynamic variation of the image data). 

However, the prior art of record fails to anticipate or render obvious the recited 
feature of the limitations cited above added with capturing the a selected playback 
image, the playback image being one of a series of display images generated over time 
by a graphical user interface (GUI) of an application program being tested by a cognitive 
control framework (CCF) system in a playback phase in response to simulated user 
inputs to the application program; detecting at least one active display object in a 
recorded image, the recorded image being one of a series of display images generated 
overtime by the GUI of the application program being tested and captured during a 
recording phase of the CCF system based on user inputs to the application program, 
the user inputs, time interval between user inputs, and resulting display data forming an 
execution scenario script for use in testing the GUI of the application program during the 
playback phase for generating playback images, the at least one active display object 
being a portion of the recorded image being acted upon as a result of user input; 
searching subsets of hypotheses of locations of display objects in the captured playback 
image for a matching display object corresponding to the detected at least one active 
display object of the recorded image according to predetermined criteria; recalculating 
old actions for the matching display object in the playback image by applying actions 
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according to the execution scenario script and loading a next set of data, when the 
corresponding matching display object is found; and checking dynamic conditions, 
including the time between user inputs. 

These features, together with the other limitations of the independent claims are 
novel and non-obvious over the prior art of record. The dependent claims being definite, 
enabled by the specification, and further limiting to the independent claims, are also 
allowable. 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance". 

Conclusion 

3. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to FAZLUL QUADER whose telephone number is 
(571)270-1905. The examiner can normally be reached on M-F 8-5 Alternate Fridays 
off. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Charles Rones can be reached on 571-272-4085. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

FAZLUL QUADER 

Examiner 

Art Unit 2164 

/FQ/ 



/Charles Rones/ 

Supervisory Patent Examiner, Art Unit 2164 



